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ABSTRACT 

The build-up of stellar mass in galaxies is the consequence of their past star for- 
mation and merging histories. Here we report measurements of rest-frame optical light 
and calculations of stellar mass at high redshift based on an infrared-selected sample of 
galaxies from the Hubble Deep Field North. The bright envelope of rest-frame 5-band 
galaxy luminosities is similar from < z < 3, and the co-moving luminosity density is 
constant to within a factor of 3 over that redshift range. However, galaxies at higher 
redshifts are bluer, and stellar population modeling indicates that they had significantly 
lower mass-to-light ratios than those of present-day L* galaxies. This leads to a global 
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stellar mass density, which rises with time from z = 3 to the present. This 

measurement essentially traces the integral of the cosmic star formation history that 
has been the subject of previous investigations. 50-75% of the present-day stellar mass 
density had formed by z ~ 1, but at z ~ 2.7 we find only 3-14% of today's stars were 
present. This increase in f2* with time is broadly consistent with observations of the 
evolving global star formation rate once dust extinction is taken into account, but is 
steeper at 1 < z < 3 than predicted by some recent semi-analytic models of galaxy 
formation. The observations appear to be inconsistent with scenarios in which the bulk 
of stars in present-day galactic spheroids formed at z S> 2. 

Subject headings: early universe — galaxies: evolution — galaxies: stellar content - 
infrared: galaxies 

1. Introduction 

One goal of observational cosmology is to understand the history of mass assembly in galaxies. 
In current models of structure formation, dark matter halos build up in a hierarchical process 
controlled by the nature of the dark matter, the power spectrum of density fluctuations, and the 
parameters of the cosmological model. The assembly of the stellar content of galaxies is governed 
by more complex physics, including gaseous dissipation, the mechanics of star formation itself, and 
the feedback of stellar energetic output on the baryonic material of the galaxies. 

While it is clear that the mean stellar mass density of the universe, Q*, should start at zero 
and grow as the universe ages, the exact form of this evolution is not trivial, and could reveal much 
about the interaction of large-scale cosmological physics and small-scale star formation physics. 
For example, there may have been multiple epochs of star formation in the universe, associated 
with changes in the ionizing radiation background. The initial mass function (IMF) may have 
been different for early generations of stars or in different environments (e.g., in starbursts versus 
quiescent disks). This would change the relation between luminosity, metal production and total 
star formation rates. Early star formation with a top-heavy IMF might leave little in the way of 
remaining stellar mass, while contributing significantly to the ionization of the intergalactic medium 
and dispersing metals into it. The total, integrated mass in stars is tightly coupled to the history 
of star formation as traced by the infrared background, and to the cold gas content of the universe, 
fijii- Reducing the uncertainties on all of these measurements will provide strong constraints on 
models for galaxy formation, while discrepancies could reveal new physics. 

Deep imaging and spectroscopic surveys now routinely find and study galaxies throughout 
most of cosmic history, back to redshifts z = 3 and earlier. A variety of studies have considered 
the evolution of the global star formation rate (i.e., averaged over all galaxies), using different 
observational tracers of star formation in distant galaxies (Lilly et al. 1996; Madau et al. 1996; 
Madau, Pozzetti & Dickinson 1998; Steidel et al. 1999; Barger, Cowie & Richards 2000; Thompson, 



-3- 



Weymann & Storrie-Lombardi 2001), or constraints from neutral gas content and/or the extra- 
galactic background light (Pei & Fall 1995; Pei, Fall & Hauser 1999; Calzetti & Heckman 1999). It 
is generally accepted that star formation in galaxies was more active at high redshift than today. 
Several investigations have found an approximately constant rate of global star formation from 
z ps 4 to 1, with a steeper decline since that epoch to the present-day, although other studies have 
questioned these results (Cowie, Songaila & Barger 1999; Wilson et al. 2002; Lanzetta et al. 2002). 
The true rates of star formation (either globally or for individual galaxies) are subject to a variety 
of uncertainties and biases, particularly regarding dust extinction and its effect on galaxy selection 
and on observational indicators of star formation. 

A complementary approach is to try to measure the stellar masses (A4) of galaxies, rather than 
the rates at which they are forming stars. This is, at least indirectly, a common motivation for 
near-infrared galaxy surveys, which observe starlight that provides a reasonable tracer of the total 
stellar mass. The stellar mass of a galaxy is dominated by older, lower luminosity, redder stars. At 
longer wavelengths, these stars provide a greater fractional contribution to the integrated light from 
the galaxy, relative to that from short-lived, massive stars. For a stellar population formed over 
an extended period of time, the luminosity-weighted mean age increases at redder wavelengths, 
and the range of possible mass-to-light ratios (A4/L) is reduced. Moreover, the impact of dust 
extinction is greatly reduced at longer wavelengths. 

Measurements of the X-band luminosity function of nearby galaxies have been aimed, in part, 
at assessing the distribution of stellar mass among galaxies at the present day. For example, in a 
recent study, Cole et al. (2001) combined data from the 2dF Galaxy Redshift Survey (2dFGRS) 
and the Two Micron All-Sky Survey (2MASS) to produce a large and well-controlled sample for 
determining the -fT-band luminosity function. They employed stellar population synthesis models 
to relate light to mass, using the colors of galaxies to constrain A4/L, and hence to derive the 
stellar mass function of galaxies in the nearby universe. Kauffmann et al. (2002) have recently used 
z-band (0.9/um) photometry and spectroscopic stellar population indices in order to evaluate the 
stellar mass content of a large sample of galaxies from the Sloan Digital Sky Survey (SDSS). 

Similar methods have been applied to galaxies at cosmological distances. Deep near-infrared 
surveys are generally intended to measure the rest-frame optical light from high redshift galaxies, 
in order to minimize the effects of active star formation and dust on galaxy selection and to more 
nearly trace their stellar masses. Brinchmann & Ellis (2000) have used if-band photometry of 
galaxies from redshift surveys of Hubble Space Telescope (HST) imaging fields to derive stellar 
masses for galaxies out to z ~ 1, studying the evolution of the global stellar mass density as a 
function of galaxy morphology. Cohen (2002) has also combined extensive redshift survey data 
with infrared photometry and evolutionary models to study the evolving stellar mass density out 
to z ps 1. Drory et al. (2001) have used an infrared imaging and photometric redshift survey, which 
covers a larger solid angle to shallower depths, to study the distribution function of stellar mass at 
the bright end of the galaxy population over a similar redshift range. At higher redshift, Sawicki 
& Yee (1998), Papovich, Dickinson & Ferguson (2001) and Shapley et al. (2001) have used deep 
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infrared data to study the stellar mass content of Lyman Break Galaxies (LBGs; cf., Steidel et al. 
1996), actively star-forming galaxies at z ~ 3 that are selected on the basis of their UV luminosity 
and the broad band color signature of the Ly a and Lyman limit breaks. 

Here, we will follow the basic approach of Cole et al. (2001), Brinchmann & Ellis (2000) and 
Papovich, Dickinson & Ferguson (2001, henceforth PDF) to determine stellar masses for galax- 
ies in the Hubble Deep Field North (HDF-N) out to z = 3, and to study the redshift evolu- 
tion of the global stellar mass density. Throughout this paper, we assume a cosmology with 
^tot,^M,^A = 1.0,0.3,0.7, and h = ff /(100 km s" 1 Mpc~ 3 ) = 0.7. We will sometimes write 
h 70 = H /(70 km s _1 Mpc -3 ). We use AB magnitudes (AB = 31.4 - 2.5 log(/„/nJy)), and denote 
the bandpasses used for #STWFPC2 and NICMOS imaging as ^300, -B45O; ^606> ^814) Jno, and 

#160- 

2. The HDF-N data 

The central region of the HDF-N which we analyze here covers a solid angle of approximately 
5.0 arcmin 2 . We use deep imaging and photometric data in seven bandpasses spanning the wave- 
length range 0.3-2.2^m, taken with #ST/WFPC2 (Williams et al. 1996), HST/NICMOS (Dickinson 
1999; Dickinson et al. 2000; Dickinson 2000; Papovich, Dickinson & Ferguson 2001; Dickinson et 
al. 2003), and at if-band with IRIM on the KPNO 4m (Dickinson 1998). The galaxy catalog was 
selected from a weighted sum of the near-infrared NICMOS images using SExtractor (Bertin & 
Arnouts 1996), and is highly complete to H\qq ~ 26.5. The point spread functions of the other HST 
images were matched to that of the NICMOS data, and photometry was measured through matched 
apertures. The ground-based -KT-band fluxes were measured using the TFIT method described in 
PDF. "Total" magnitudes are approximated by measurements in elliptical apertures defined by 
moments of the light profile (SExtractor MAG_AUTO). In cases where neighboring objects pene- 
trate the elliptical apertures, photometric contamination was handled by symmetric replacement of 
pixels within the "intruder" by values drawn from the opposite side of the galaxy being measured. 
The colors used for the photometric redshift and spectral fitting analyses described below were 
measured through isophotal apertures defined in the summed NICMOS detection image and fixed 
for the other bands. 

The most complete collection of HDF-N redshifts known to the authors was employed, taken 
primarily from Cohen et al. (2000), Cohen (2001), and Dawson et al. (2001), and references therein, 
plus a few additional redshifts made available by K. Adelberger and C. Steidel (private communica- 
tion). Spectroscopic redshifts are used whenever possible, but these only cover the ~ 170 brightest 
galaxies in the sample. For the remainder, we use photometric redshift estimates fit to our catalog 
by Budavari et al. (2000). Where comparison is possible, these photometric redshifts give excellent 
agreement with the spectroscopic values, with 91% of objects (at all redshifts, < z < 6) hav- 
ing \A Z \ = \zphot — z spec \/(l + z sp ec) < 0.1, and only 5% "catastrophic outliers" with \A Z \ > 0.2. 
Cohen et al. (2000) have reported lower quality or confidence classes for some of these outliers. 
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Many of them were also noted by Fernandez-Soto et al. (2001), and in some cases the spectroscopic 
redshifts were subsequently updated by Cohen (2001) or Dawson et al. (2001). In a few cases 
where we strongly suspect that a discrepancy remains (Williams et al. (1996) catalog objects 3-355, 
z S pec = 0.474; 4-316, z spec = 2.801; 4-445, z spec = 2.500), we have adopted our photometric redshift 
estimates {z p hot = 1-20, 1.77 and 1.44, respectively) over the reported spectroscopic values (see also 
PDF for a discussion of the two higher redshift objects). 

The RMS fractional redshift difference for objects with |A 2 | < 0.1 is <j(A 2 ) = 0.031 at z < 1.9, 
and a(A z ) = 0.038 at z > 1.9. We cannot be certain that this uncertainty or the error rate does 
not increase at fainter magnitudes, below the spectroscopic limit, but as we will see, most of the 
luminosity and mass density in the HDF is contained in the more luminous objects, so photometric 
redshift errors near the catalog limits should not play a major role. We will discuss the importance 
of photometric redshift uncertainties in §6.3. 

Ten spectroscopically identified galactic stars, plus five other, fainter point sources with colors 
(primarily Juq — H\qq vs. Vqo6 — hu) similar to those of the known stars, have been eliminated 
from the catalog. Because we are interested in the rest-frame optical light, we limit our sample to 
galaxies at z < 3, where the deep -Hi60 images measure rest-frame wavelengths of 0.4/um or redder. 
Altogether, our HDF-N sample consists of 737 galaxies with Hieo < 26.5 and z < 3. 

3. Stellar mass estimates 

In order to estimate the stellar masses of HDF-N galaxies, we fit their broad-band photometry 
using model spectra generated using a recent (2000) version of the stellar population synthesis code 
of Bruzual & Chariot (Bruzual & Chariot 1993; Bruzual 2000). The procedure used here is identical 
to that described in PDF, to which the reader is directed for a full account. It is also conceptually 
similar to the methods used by other studies at lower redshifts to which we will compare our 
results. Very briefly, we generate a large suite of model spectra, varying the model age, the time 
scale of star formation (from instantaneous bursts through constant rates) , and the dust extinction 
(parameterized using the "starburst" attenuation law of Calzetti et al. (2000)). Other parameters, 
which cannot be well constrained (if at all) from photometry alone, are held fixed. We discuss 
some of these parameters below. We fit each model spectrum to the galaxy photometry, excluding 
bands which fall below Ly a. We select the best model based on the x 2 statistic, and use Monte 
Carlo simulations to define the 68% confidence interval in our model parameters by perturbing the 
galaxy photometry randomly within its error distribution. 

PDF examined the dependence of the derived stellar population parameters for z > 2 LBGs on 
the form of the extinction law. While changing from the flat starburst law to a steep SMC extinction 
curve had a strong impact on some of the derived quantities, such as ages or star formation rates, 
the distribution of LBG stellar masses was virtually unchanged. Therefore, we have not further 
explored this as a variable in the present investigation. We have also fit models with different (but 
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fixed) metallicities (Z). Here, we will use results from models with Z = 0.02 (i.e., approximately 
solar) and 0.004 to estimate the range of systematic uncertainty due to mctallicity effects. 

Any conversion of light to stellar mass requires certain assumptions, most notably about the 
initial mass function (IMF) of star formation. In the present analysis, we adopt a Salpeter (1955) 
IMF with lower and upper mass cutoffs of 0.1 and 100 M®, which allows us to compare our 
results to others from the literature for galaxies at lower redshifts. To first order, varying the 
IMF simply scales our derived M/L up or down. Adopting an IMF with a larger low-mass cutoff 
or flatter low-mass slope would result in smaller derived galaxy masses for the same amount of 
optical or near-infrared light. This difference is a factor of ~ 2 for the IMFs of Kennicutt (1983) 
or Kroupa (2001). However, the evolution of stellar mass in galaxies, which we discuss here, 
should be largely independent of the faint-end slope of the IMF, provided that the IMF itself 
does not evolve. Changing the IMF at intermediate to high stellar masses, however, can introduce 
systematic differences in the evolution of M/L(Xq) with stellar population age and as a function 
of the rest-frame wavelength Ao- Note that both stellar masses and star formation rates derived 
from photometric observations depend strongly on assumptions about the IMF, but in somewhat 
different ways. Most observational indicators of star formation are sensitive only to very high 
mass stars, requiring large and IMF-dependent extrapolations to the "total" star formation rate. 
Rest-frame infrared and optical photometry generally measures light from stars spanning a broader 
range of masses. We will touch on issues related to the IMF again in §6.1. 

As discussed in PDF, the range in M/L for models which fit the HDF-N galaxy photometry 
depends on the assumptions about their previous star formation histories, ^(t). As in that paper, 
we bound the range of possible star formation histories by using two sets of models. In one, we 
parameterize ^>(t) oc exp(— t/r), with time scale r and age t as free parameters. These models span 
the range from instantaneous bursts to constant star formation. The model ages are restricted to 
be younger than the age of the Universe at the redshift of each galaxy being fit. Since very young 
ages with active star formation and no dust are allowed, this set of models includes the minimum 
permissible M/L for each galaxy. The second set of models sets an upper bound on the stellar mass 
by adopting a rather artificial, two-component star formation history. The "young" component 
is modeled with an exponential ^(t) as described previously. The "old" component is formed in 
an instantaneous burst at z = oo, providing a maximally old population. Given its age (> 2 Gyr 
for z < 3), this old component is assumed to be unreddened. In principle, arbitrarily large masses 
could be invoked by freely adding extinction to the older component, but we do not consider such 
models here, and will refer to our 2-component models has having the "maximum M/L" consistent 
with the photometry. More complex star formation histories are bracketed by results from these 
two sets of models. 

For LBGs at z ~ 3, PDF found that vigorous, ongoing star formation can (in principle) mask 
the presence of a more massive old stellar population. The two-component models provided stellar 
masses that were, on average, ~ 3 times larger than those from the one-component models, with 
a 68% upper bound pa 6-8 times more massive. For galaxies at lower redshifts, we find that this 
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mass ratio between the two- and one-component models is generally smaller for several reasons. 
First, at z < 2 the infrared photometry reaches redder rest-frame wavelengths, and thus provides 
a better constraint on the old stellar content. Second, many galaxies at z < 2 are redder than the 
LBGs (evidently with more quiescent star formation relative to their total stellar masses), and thus 
cannot hide as much stellar mass in a maximally old component. 

4. Galaxy light and mass in the HDF-N 

Figure 1 shows the rest-frame S-band luminosities of HDF-N galaxies as a function of redshift 
z (top axis), and of the co-moving volume out to redshift z (bottom axis). This plotting scheme 
has the virtue that the horizontal density of points shows the co-moving space density of objects. 
The rest-frame .B-band luminosities were computed by interpolating between the fluxes measured 
in the 0.3-2.2/xm observed bandpasses. We converted to solar units assuming a 5-band specific 
luminosity for the Sun of L U ^@(B) = 3.17 x 10 18 erg s _1 Hz -1 . The curve in Figure 1 shows an 
approximate completeness limit for the NICMOS sample, assuming a magnitude limit H wo < 26.5 
and a flat-spectrum f v spectral energy distribution. Roughly speaking, the upper envelope of 
galaxy luminosities is similar for < z < 3. The most optically luminous galaxy in the HDF-N is 
a red, giant elliptical FR I radio galaxy at z = 1.050 (4-752), although another (possibly binary) 
galaxy at z = 2.931 (4-52) comes close. 

Although bright galaxies have similar space densities in the HDF-N out to z = 3, their stellar 
populations do not remain the same. Figure 2 presents the rest-frame UV-optical colors of HDF- 
N galaxies versus redshift, showing a strong trend toward bluer colors at higher redshift. This 
effect cannot be attributed to selection biases because the sample is selected at near-infrared 
wavelengths. All points shown in Figure 2 are measurements, not limits; no object from the 
NICMOS sample studied here is undetected in the WFPC2 HDF-N. For galaxies at z ~ 2.7, the 
rest-frame 1700— .B color is approximately matched by the observed V§q§ — H±qq. For the range of 
galaxy magnitudes we find at that redshift (23 < -Hi60 < 26.5), we could have measured colors as 
red as 6 > V<306 — -H16O > 4, but none are found. The trend toward bluer colors at higher redshift 
presumably reflects a tendency toward younger stellar populations and increasing levels of star 
formation in more distant galaxies. As noted by PDF, nearly all HDF-N galaxies at z > 2 have 
colors much bluer than those of present-day Hubble sequence galaxies, more similar to those of very 
active, UV-bright starburst galaxies. We may thus expect that the typical stellar mass-to-light 
ratios are lower for galaxies at higher redshift. 

Figure 3 shows the best-fitting stellar mass estimates for HDF-N galaxies, calculated using the 
1-component (i.e., single exponential) SFR history models described in §3. Unlike the luminosities 
plotted in Figure 1, the upper envelope of galaxy masses declines markedly at higher redshift, 
and the space density of massive galaxies (say, M > W 10 Mq) thins out. PDF found that the 
characteristic stellar mass of HDF-N LBGs is ~ 1O 1O A4 . Even using a complete, infrared-selected, 
photometric redshift sample (which should be free of rest-frame UV selection biases), we do not 
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find additional galaxies at similarly large redshifts with stellar masses greater than those of the 
bright HDF-N LBGs. The curve in the figure shows the stellar mass corresponding to a maximally 
old, red stellar population formed at z = oo, aging passively, with Hiqq = 26.5. The NICMOS 
sample should be complete for galaxies with M > W 10 Mq nearly out to z = 3. At any redshift, 
some galaxies below this curve - those objects that are bluer than the maximum- M/L, passive 
evolution limit - can be detected. However, we cannot rule out the possibility that we are missing 
faint, red, fading galaxies with masses that fall below the curve in Figure 3, but which might be 
too faint to detect in the NICMOS images. 

As discussed in §3, we may set an upper bound on the stellar masses by adopting 2-component 
SFR models which include a maximally old component formed at z = oo. This has a greater effect 
on the masses of the galaxies at higher redshift, where the observed colors are generally bluer and 
the photometric measurements do not reach as far to the red in the galaxy rest frame. Nevertheless, 
the basic character of Figure 3 remains the same even when these "maximal" mass estimates are 
used. Even with the maximum M/L models, very few galaxies at z > 1.4, and no galaxies at 
2 < z < 3, have M > W 11 Mq. Using either SFR model, the most massive galaxy in the HDF-N 
is the z = 1.05 gE 4-752.0, and the most distant galaxy with M > lO 11 ^© is the gE host galaxy 
(4-403.0) of the z » 1.75 type la supernova SN1997ff (Gilliland, Nugent & Phillips 1999; Riess et 
al. 2001). 

We will not discuss galaxies at z > 3 in this paper because the NICMOS data do not probe the 
rest-frame optical light at those redshifts. However, one object which warrants special attention 
is the "J-dropout" object J123656. 3+621322 (Dickinson et al. 2000), which has the reddest near- 
infrared colors of any object in the HDF-N. Its redshift is unknown; it might conceivably be an LBG 
or QSO at z > 12, a dusty object at intermediate redshift, or an evolved galaxy with an old stellar 
population at high redshift. This latter possibility is most relevant here, as it might imply a large 
stellar M/L. If we adopt a best-fit z p hot = 3.3 for this object (excluding the z > 12 option), we find 
that this object can be fit with an old (~ 1.6 Gyr) stellar population with moderate dust extinction 
(required to match the red J — H color - cf. Dickinson et al. (2000)), and M ~ 1 x lO 11 ^©. If this 
interpretation were correct, this object would be significantly more massive than any other HDF-N 
galaxy at z > 2. The only other object at z > 3 with a fitted M > 1O 11 A40 is a broad-line AGN 
(4-852.12, z = 3.479), whose luminosity and colors are probably significantly affected by the active 
nucleus, and where stellar population model fitting is therefore inappropriate. The comparatively 
red (and X-ray luminous) galaxy HDFN J123651. 7+621221, at z phot = 2.7 (see Figure 2), is fit 
with a modest M « 1.5 x 1O 1O A4 . 



5. The global luminosity and stellar mass densities 

The HDF-N is a very narrow pencil-beam survey along a single sight-line, and any statistical 
analysis of its most luminous or massive galaxies is subject to small number statistics and to density 
variations due to clustering. We therefore adopt a very crude approach here, dividing the volume 
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at 0.5 < z < 3 into four redshift bins with approximately equal co-moving volume « 10 4 Mpc 3 
each: z\ to z u = 0.5-1.4, 1.4-2.0, 2.0-2.5, and 2.5-3.0. The co-moving volume at < z < 0.5 is 
< 1000 Mpc 3 , and we do not consider galaxies in that redshift range further here, although nearly 
40% of the lifetime of the universe elapses in that interval. Based on the 2dFGRS optical luminosity 
function of Norberg et al. (2002), in the local universe we would expect ~ 12 galaxies with L > L* B 
in a volume of 10 4 Mpc 3 . From the 2dF+2MASS stellar mass function of Cole et al. (2001), we 
would expect ~ 6 galaxies with M > M*{= 1.4 x lO 11 ^©) in the same volume. 

Figure 4 shows the cumulative luminosity densities pl{> Lb) from the local 2dF luminosity 
function and from the HDF-N redshift slices. The HDF-N data are deep enough so that the 
luminosity densities are roughly convergent within each redshift slice at the detection limit. In 
each redshift interval, we evaluate the integrated S-band luminosity density and its uncertainty 
in several ways. First, we obtain a direct estimate, without extrapolation to fainter luminosities, 
by summing the galaxy luminosities, weighted inversely by the volumes over which they could be 
detected (the l/V max formalism of Schmidt (1968)). For each galaxy, the maximum redshift to 
which it could be seen with Hiqq < 26.5 is calculated, using the multiband photometry for each 
object to compute the fc-corrections directly. Most galaxies are visible throughout their redshift 
slices z% < z < z u , but when z max < z u , then z max is used to compute the 1/V max weighting. The 
volume-weighted luminosities are then summed, and the uncertainty in this value is estimated by 
bootstrap resampling. Second, we have fit Schechter (1976) functions to the number densities in 
log(L#) bins, estimating parameter uncertainties using Monte Carlo simulations where the numbers 
of objects per bin were varied within a Poisson distribution. The Schechter functions generally give 
acceptable fits, except for the lowest redshift interval, where reduced \ 2 = 2.1, mainly due to 
an inflection at the faint end which has little impact on the integrated luminosity density. 6 The 
individual Schechter function parameters, <fr* , L* , and a, are moderately well constrained for the 
lowest redshift subsample (0.5 < z < 1.4), where 382 objects are used, spanning nearly a factor of 
1000 in luminosity. The best-fitting Schechter function parameters for this redshift bin, expressed 
in the bj band (conventionally normalized to Vega) for comparison to local determinations, are 
M* j = -20.47 ± 0.35 + 51og/i, <p* = (2.0 ± 0.5) x 10~ 2 /i 3 Mpc" 3 , and a = -1.16 ± 0.07. The 
luminosity function parameters are more poorly determined at higher redshifts, but in general the 
integrated luminosity densities, pL = L*4>*F(a + 2), are better constrained. 

Table 1 presents the results of the luminosity density integration using both methods. At 
z < 2.5, the Schechter function integrations yield values for pi which are within 0.1 dex of the 
direct sums, confirming that the HDF observations are detecting most of the light at those redshifts. 
In the highest redshift interval (2.5 < z < 3), our sample has only 45 galaxies spanning a range 
of ~ 30 in luminosity, and the Schechter function slope a is poorly constrained, leading to larger 



Note that the universe nearly doubles in age between z = 1.4 and 0.5. The faintest galaxies used in the luminosity 
function analysis are all at the low end of the redshift range. It may not be surprising that a simple Schechter function 
does not fully represent the (quite likely evolving) luminosities in this interval. 
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uncertainty in pi; > 5% of the Monte Carlo simulations lead to divergent pL (i.e., a < —2). For 
the purposes of this analysis, we have refit the data in the highest redshift bin fixing the slope to 
a = —1.4, the steepest value found in the lower redshift ranges, but still somewhat shallower than 
a = —1.6 for the rest-frame UV luminosity function of LBGs (Steidel et al. 1999). 

Our estimates of the rest-frame .B-band luminosity density, along with various measurements 
from the literature, are shown in Figure 5. At z ~ 1, we find that p(Lb) is ~ 2.5x larger than that 
in the local universe (log(pL/L & ) = 8.1, Norberg et al. (2002)), consistent with previous results. 7 
The luminosity function and density are consistent with modest luminosity evolution (0.85 mag 
for rest-frame L* B ) and 25% higher space densities ((f)*) at z « 1 compared to the present day. 
At higher redshift (1.4 < z < 3), the luminosity density is roughly constant at ~ 1.5x the local 
value. However, we have seen that galaxies at higher redshift have bluer colors and presumably 
lower mass-to-light ratios. Hence, the density of stellar mass may be expected to evolve differently 
than that of the light. 

To compute the stellar mass density in each redshift slice, we begin by summing the masses 
for everything that we can see, e.g., p*(> Lb). As noted above, for the oldest possible stellar 
populations with maximum M/L we can only be certain of being complete down to the mass 
limits shown by the line in Figure 3. Thus we can confidently detect objects with M > 4 x 10 9 Mq 
out to z = 2 and M > 10 10 Mq out to nearly z = 3, but we cannot be completely certain that some 
objects with smaller masses but large M/L are not missed. As noted above, there is little evidence 
for a significant population of galaxies at z > 2 with M/L much larger than that seen for LBGs, 
so it might be surprising if such a population were to appear fainter than the detection limit of the 
NICMOS data. Also, at all redshifts in the HDF-N sample, the mean (M/L) is either declining 
or flat with decreasing Lb (cf. Figure 1 from PDF, where a mild tendency toward bluer colors 
at fainter magnitudes is seen for LBGs at 2 < z < 3.5). This is a well-known trend in the local 
universe (cf. Kauffmann et al. (2002)): fainter galaxies on average tend to have bluer colors and 
lower stellar M/L. This effect would be even more pronounced if our stellar population modeling 
had incorporated a trend of increasing metallicity with mass or luminosity. 

Parenthetically, it is worth noting that Shapley et al. (2001) have reported evidence for an 
extremely steep faint-end slope to the rest-frame optical luminosity function of LBGs at z « 3, 
as well as a tendency for fainter galaxies to have redder UV-optical colors, and hence presumably 
larger M/L. These two trends are intimately connected in the Shapley et al. (2001) sample, since 
they infer the observed-frame -fT s -band luminosity distribution from the observed 7£-band data 
(with which Steidel et al. (1999) measured ajjv = —1-6) and the 1Z — K s color distribution of 
galaxies in their sample. Taken at face value, these facts would imply a very large mass density 



7 At 0.75 < z < 1.0, Lilly et al. (1996) find \og(pL / Lq) = 8.50±0.13, where we have adjusted their measurement to 
the cosmology adopted here. This value is in excellent agreement with our value at (z) = 1.05 (0.5 < z < 1.4). Recent 
results based on photometric redshifts from the COMBO-17 survey find a somewhat smaller value, \og(pL/ Lq) = 
8.35 ± 0.08, at 0.8 < z < 1 (Wolf et al. 2002). 
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of faint red galaxies at z « 3, below the magnitude limits of ground-based Lyman break galaxy 
surveys. The Shapley et al. (2001) sample, however, spans a limited range of luminosities, restricted 
to the bright end of the LBG distribution. It is very difficult to constrain the faint end slope with 
such data; we are unable to do so reliably even with our deeper NICMOS sample. Moreover, 
we find no such reddening trend with fainter magnitudes for HDF-N LBGs, pushing well below 
the magnitude limits of the ground-based samples. If anything, the opposite seems to be the 
case. For the moment, therefore, we discount this result from Shapley et al. (2001), but we stress 
the important caveat that even the deepest near-infrared data and photometric redshift samples 
presently available cannot definitely constrain these important properties of the galaxy distribution 
at z > 2.5, leaving genuine uncertainty about the integrated stellar mass content at such redshifts. 

The cumulative stellar mass density p*(> Lb) in the four HDF-N redshift slices is presented 
in Figure 6. As discussed above, the fitted mass estimates depend on the model metallicities and on 
the adopted star formation histories. Here, we show the range of mass densities obtained by varying 
the model metallicities from 0.2 to 1.0 x Z Q , and from the single and 2-component SFR history 
models. The dependence of the mass densities on these model assumptions is less than a factor of 
2 at z ~ 1, but can be as much as a factor of 4 out at z ~ 2.7. At z < 2.5, the mass densities are 
approximately convergent. At z > 2.5, p* from the 1-component models appears to be converging, 
but is still rising for the 2-component, maximum M/L models. This is a consequence of the 
mass completeness limit drawn in Figure 3. Just as galaxies might be present, but undetected by 
NICMOS, with masses that fall below that curve, any faint galaxy that is detected may in principle 
have an unseen old stellar component with mass roughly equal to that shown by the completeness 
line. The maximum M/L, 2-component models therefore permit the potential existence of a galaxy 
population with M/L oc L^ 1 below some threshold mass set by the NICMOS detection limits. 

For each redshift interval, we calculate the volume-averaged mass-to-light ratio {M/L) by 
taking the ratio of the mass and .B-band luminosity densities for the observed galaxy populations. 
Our calculations of {M/L) under various stellar population assumptions are presented in Table 2. 
For comparison, the 2dFGRS measurements of Norberg et al. (2002) and Cole et al. (2001) yield 
a local value {M/L) = 4AMq/L q . This is significantly larger than the values we derive at high 
redshift, implying substantial evolution in the mean stellar population properties (averaged over all 
galaxies) from z ~ 1 to the present. We multiply the computed {M/L) values by our estimates of 
the total pl from the Schechter function integration described above. Note that if M/L decreases 
at fainter luminosities, this procedure will slightly overestimate the stellar mass density. The 
random uncertainty in p* is estimated from the combined uncertainties in pl and the quadratic 
sum of the mass fitting uncertainties (for each particular choice of model metallicity and *(i)) for 
the galaxies in each redshift range. The systematic dependence of the results on these choice of 
stellar population model assumptions is illustrated below, and our results are tabulated in Table 3. 
Note that we have used the rest-frame i?-band primarily as an accounting device here, calculating 
(M/Lb) and using a Schechter fit to the luminosity function to correct for sample incompleteness 
at the faint end. Our stellar masses are actually derived using NICMOS and ground-based near-IR 
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observations that reach significantly redder rest-frame wavelengths (0.54-1.44/xm for the K s -band 
data) over the entire redshift range being considered here. 

Regardless of the model adopted for the mass estimates, there is good evidence that the global 
stellar mass density increased with cosmic time. E.g., for galaxies brighter than present-day L* B , 
which are abundant in the HDF-N at all redshifts z < 3, the minimum estimate for p* at z ~ 1 is 
~ 7x larger than that from the maximum A4/L models at z ~ 2.7. 

Figure 7 places the HDF-N mass density estimates into a global context, comparing them with 
other data at < z < 1, where the HDF-N itself offers little leverage due to its small volume. The 
local stellar mass density is taken from Cole et al. (2001), integrating over their fit to the stellar mass 
distribution of 2dFGRS galaxies. This value is consistent with earlier estimates by Fukugita, Hogan 
& Peebles (1998) and Salucci & Persic (1999), but has smaller statistical uncertainties. Values at 
0.3 < z < 1 are taken from Brinchmann Sz Ellis (2000) and Cohen (2002), with adjustment for 
the change in cosmological parameters to those adopted here. Our own estimates of fi*, as well 
as those of Cole et al. (2001) and Cohen (2002), integrate over luminosity functions to estimate 
the total luminosity and mass densities. Brinchmann & Ellis (2000) computed p* by summing 
over galaxies in the range 10.5 < \og(M/M.o) < 11.6, without extrapolating further down an 
assumed mass function, and thus their published values are strictly lower limits. Those authors 
estimate that their summation accounts for > 80% of p*, and we have therefore applied a 20% 
upward correction to their points to roughly account for this incompleteness. Note also that Cole 
et al. (2001) fit metallicities for each galaxy, primarily based on near-infrared colors. From their 
Figure 11, it appears that most 2dFGRS galaxies are best fit with models close to solar metallicity, 
and generally not lower than Z = 0.004. Brinchmann & Ellis (2000) also allow metallicity to vary 
from 0.004 to 0.02 in their mass fitting, while Cohen (2002) adopt evolutionary corrections based 
on population synthesis models from Poggianti (1997), which include chemical evolution. We have 
found (see PDF) that we cannot set reliable photometric constraints on metallicity for the higher 
redshift galaxies, and therefore have used different (but fixed) values to explore the systematic 
dependence of p* on Z. 



6. Discussion 

6.1. The evolution of the global stellar mass density 

At z ~ 1, we find that 50-75% of the present-day stellar mass density had already formed, 
depending on the stellar population models adopted. Our estimates are consistent with those from 
Brinchmann & Ellis (2000) and Cohen (2002), who studied larger samples over greater volumes at 
0.3 < z < 1. Our HDF-N analysis alone does not offer sufficiently fine redshift resolution to further 
pin down the epoch when (e.g.) 50% of the stars in the universe had formed, but it seems to have 
taken place somewhere in this range. 
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At z > 1.4, we see a steep drop in the total stellar mass density with increasing redshift. The 
systematic uncertainties in our mass estimates are large at z > 2, primarily because the NICMOS 
near-infrared measurements sample only rest-frame optical wavelengths in the B— to U-band range, 
loosening our constraints on M./L. In addition, even these NICMOS observations do not go deep 
enough to tightly constrain the luminosity function at z > 2.5, although a fairly robust estimate 
of the luminosity density can be made with only modest and reasonable constraints on the faint 
end slope a. Nevertheless, the apparent change in the stellar mass density is sufficiently dramatic 
as to exceed the substantial uncertainties in the measurements. For our fiducial stellar population 
models with solar metallicity and exponential star formation histories, the mass density changes 
by a factor of 17 from z ~ 2.7 to the present-day. Even for the "maximum A4/L" 2-component 
models, is ~ 7x smaller at z ~ 2.7 than at z = 0. Even if all galaxies in the highest redshift 
bins were set at their 68% upper confidence limits of their mass estimates for this model, we would 
find less than l/3rd of the present-day mass density present. 

The quantity p*(z) is essentially the time integral over the cosmic star formation history 
SFR(z) = p\(z). 8 The blue curves in Figure 7 show the integral over SFR(z) inferred from rest- 
frame UV light (e.g., Lilly et al. (1996); Madau, Pozzetti & Dickinson (1998); Steidel et al. (1999)), 
using parameterized fits given by Cole et al. (2001) (extrapolated to z max = 7). The integration 
incorporates the time-dependent recycling of stellar material back to the ISM from winds and 
supernovae, following the relation for a Salpeter IMF and solar metallicity calculated with the 
Bruzual & Chariot models. Asymptotically, this recycled fraction R = 0.32 at age = 13 Gyr. 

It is now widely believed that measurements based on rest-frame UV light underestimate the 
total rate of high redshift star formation unless corrections for dust extinction are included. This 
can also be seen from the integrated stellar mass, £l*(z), as well. The curves in Figure 7 show the 
integrated SFR(z) with and without nominal corrections for dust extinction taken from Steidel et 
al. (1999). As Madau, Pozzetti & Dickinson (1998) and Cole et al. (2001) have previously noted, 
without the boost from an extinction correction, this integral results in a present-day mass density 
which is substantially smaller than the observational estimates. Here, we can see that this is true 
over the broader redshift range < z < 3, although at z > 2 the inconsistency is small given 
the systematic uncertainties in p*. On the other hand, the extinction-corrected SFR(z) results 
in p*(z) which agrees fairly well with observations at z ~ and z ~ 1, but which exceeds our 
best estimates at higher redshifts. Again, given the modeling uncertainties, these estimates are 



8 Note that in our analysis we have not imposed any continuity between our estimates of p*(z) and the ensemble 
star formation history, p*{z), from the stellar population models that were used to derive the masses. In principle, 
p» could even decrease with time, which would be inconsistent with any SFR(z). (In practice this is not observed.) 
Our "maximum M / L" models may be logically inconsistent with evidence for £7, rising with time, since they assume 
that a large fraction (generally the majority) of the stellar mass in galaxies formed at infinitely high redshift (and 
thus was always present), whereas even the maximum mass models show p* rising with time. These models should 
therefore be regarded as illustrative (at a given redshift) only, representing the most conservative assumption we can 
make without postulating large amounts of stellar mass in galaxies that are invisible to our NICMOS imaging. 
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consistent with the upper bounds from the maximum M/L models, but as noted above, this class 
of mass models is somewhat unrealistic and inconsistent when considered over a wide range of 
redshifts. The parameterized SFR(z) from Cole et al. (2001) rises by a factor of ~ 2 from z = 4 to 
its peak at z ~ 1.5. A flatter star formation history at z > 2 would exacerbate this discrepancy. 

Pei, Fall & Hauser (1999) have used measurements of the UV luminosity density and neutral 
gas density as a function of redshift and the far-infrared background to constrain a self-consistent 
solution for the global star formation history. Their solution (from their Figure 12), converted 
to our adopted cosmology, is shown as the green solid curve in Figure 7, while the shaded region 
shows their 95% confidence interval. The result and its uncertainty range are in impressively good 
agreement with the data (and their uncertainties) at all redshifts, providing encouragement that 
these different observables can be united within a common framework for galaxy mass assembly at 
< z < 3. 

Figure 8 reproduces the data points from Figure 7, superimposing results for f2*(z) from recent 
semi-analytic models of galaxy evolution by Cole et al. (2000) and Somerville et al. (2001). These 
models use the same cosmological parameters as we have adopted here. The calculations of Cole et 
al. (2000) used the IMF of Kennicutt (1983). We have approximately rescaled to a Salpeter IMF 
by multiplying p*(z) by a factor of 2. We also shows results from the iV-body plus semi-analytic 
models of Kauffmann et al. (1999). Because of their mass resolution, these model outputs (taken 
from the Virgo Consortium web site) are limited to stellar masses M > W 10 M Q at z > 1.4 and 
M. > 2 x W 10 M-q at z < 1.4. This is similar to the characteristic stellar mass of LBGs at high 
redshift, and thus a large extrapolation would be required to estimate the total p*. We fit the 
slope of the differential mass function in the models and integrated to compute the stellar mass 
density p*(> W w Mq) at all redshifts, but have not extrapolated further. Kauffmann et al. (1999) 
assume the IMF of Scalo (1986), requiring an additional adjustment, possibly redshift dependent, 
for comparison to our assumed Salpeter IMF. Very roughly, we have accounted for this, as well as 
for the extrapolation to "total" integrated f2*, by simply rescaling the model p* so that it matches 
the value from the 2dFGRS at z = 0. 

In the model of Cole et al. and the favored "collisional starburst" model of Somerville et al., 
the peak redshift for star formation is at z ss 2.5 to 4. Hence, these models show somewhat flatter 
evolution of £l*(z), with a larger fraction of the stars in the universe formed at z > 1.5 than our 
data suggest. Kulkarni & Fall (2002) have noted that some semi-analytic models also overpredict 
the mean metallicity in damped Lyman a absorption line systems at high redshift, for similar 
reasons. Star formation in the "constant quiescent" model of Somerville et al. peaks at lower 
redshift [z « 1.5), yielding better agreement with the high redshift data, but underpredicting f2* 
at < z < 1.5. The model of Kauffmann et al. (1999) (after rescaling to match the data at z = 0) 
appear to match the shape of fi*(z) somewhat better than do the other models. However, given 
the shapes of the mass functions in their simulations, one would expect that a proper extrapolation 
to total p* would have a larger effect at higher redshifts. This would most likely flatten the Cl*(z) 
evolution somewhat, and therefore the higher redshift points from the Kauffmann et al. models 
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should probably be regarded as lower limits. 

Broadly speaking, our estimates of Q*(z) favor a global star formation history whose rate peaks 
at 1 < z < 2 and is smaller at higher redshift. A higher peak redshift for SFR(z), or a flat rate out 
to z 3> 3, would appear to be inconsistent with our measurements, producing too many stars at 
2 < z < 3 relative to the mass density at lower redshifts. Ferguson, Dickinson & Papovich (2002) 
have noted a conflict between the stellar mass content inferred for z ~ 3 LBGs and the evidence 
for substantial amounts of star formation at higher redshifts, as seen directly in the z ~ 4 LBG 
population, or as implied by the radiation required to reionize the Universe at z > 6. A constant 
rate of star formation at 3 < z < 6+ would overpredict the stellar masses of LBGs at z ~ 3, as well 
as f2* at that redshift. 

Neither the current data, nor the theoretical predictions, are yet sound enough to imply a 
definite paradox. If necessary, however, there may be several ways to reconcile our measurements 
of Q,*(z) with evidence for larger star formation rates at higher redshift. First, we might have 
underestimated luminosity or mass densities at high redshift. For example, Lanzetta et al. (2002) 
have suggested that failure to account for surface brightness dimming has led to underestimates 
in the UV luminosity density, and hence the star formation rate, at high redshift. Although 
we stress that we have not used isophotal photometry here, virtually any photometry scheme is 
subject to some biases, and we might nevertheless have underestimated the near-IR fluxes (and 
hence masses) of high-z objects. We may also be missing light from a population fainter than our 
NICMOS detection limits, either due to a steep upturn in the luminosity function, or because of a 
steep increase in M./L at fainter luminosities. We note that surface brightness biases would quite 
probably affect estimates of both SFR(z) and p*(z) in similar ways, so that the inconsistency might 
not be significantly narrowed even if corrections were made for missing light. The results on p*(z) 
do not allow much room for substantially higher rates of star formation at high redshift, either due 
to surface brightness effects or dust obscuration, unless the stellar mass estimates are also grossly 
underestimated. 

It is also possible that our assumption of a constant IMF at all redshifts could be wrong. One 
solution proposed by Ferguson et al. is to tilt the IMF toward massive star formation at higher 
redshifts. With a flatter IMF, the massive stars that would produce UV radiation at the reionization 
epoch, or from LBGs at z ~ 4, are accompanied by a smaller total formation rate of stellar mass, 
which is dominated by lower-mass, long-lived stars. In this way, we may reconcile the UV output 
at z 3> 3 with the relatively low fi* seen at 2 < z < 3. Eventually, however, there must be a 
change in the IMF to produce the longer-lived stars which dominate the stellar mass build-up at 
1 < z < 3. It is not clear how to realistically incorporate a time- or redshift-dependent IMF into 
current models of galaxy evolution, but this may become necessary. 

It is also interesting to note the relative paucity of galaxies with A4 > 10 n .A4o at almost 
any redshift in the HDF-N (see Figure 3). Cole et al. (2001) find a characteristic stellar mass 
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of present-day galaxies 9 M* = 1.4 x lO 11 ^©. There are only a handful of HDF-N galaxies at 
0.5 < z < 2 which exceed this mass, despite adequate total volume to have found roughly a dozen in 
the local universe. This is true even when the maximum M /L 2-component star formation models 
are adopted for the HDF-N galaxies. This might be attributable to small number statistics and 
to the small co-moving volume of the HDF-N. The most massive galaxies are rare, and moreover 
they may be expected to cluster strongly, making it still more difficult to take a fair census from 
a single sight line, small- volume survey. However, it might also indicate that the most massive 
galaxies continued to build up their stellar content at relatively late epochs, either by merging or 
late star formation, even after the time when much of the overall density of stars in the universe 
had already formed. 

Although we cannot yet derive robust stellar mass functions at high redshift from our data, the 
qualitative behavior seen in Figure 3 is reminiscent of that found in recent cold dark matter models 
of galaxy formation in a A-dominated universe. Baugh et al. (2002) show stellar mass functions at 
various redshifts derived from the models of Cole et al. (2000), and similar results can be extracted 
from the models of Kauffmann et al. (1999) available from the Virgo Consortium web site. Locally, 
galaxies with stellar masses M w 10 11 hjf}M Q have a space density ^2x 10~ 3 /if 3 Mpc" 3 . We 
consider objects at a fixed space density corresponding to that of lO 11 ^© galaxies at z = 0. In 
both sets of models, at z s=s 1, 2, and 3, the stellar mass of objects with this characteristic space 
density has decreased by factors of ~ 2, 4, and 10, respectively. At z = 3, the characteristic 
mass is approximately lO 10 ^©, as found by PDF. The models differ in their predictions for the 
space density of 10 n A4© objects, with Baugh et al. (2002) finding more rapid evolution. This is 
unsurprising in the exponential part of the mass function, where small differences along the mass 
axis correspond to very large differences in space density. Both models, however, predict that 
4>(10 u A4q) changes by more than an order of magnitude between z = 2 and 1, and that galaxies 
with that mass largely disappear by z = 3, with a space density less than 1% of that locally. 

Although we find no HDF-N galaxies at z > 2 with A4 > 10 11 A / 1©, this does not mean that such 
galaxies do not exist in the Universe. Shapley et al. (2001) find a small number of LBGs with inferred 
■M > lO 11 ^© among a sample taken from their large, ground-based survey. Moreover, there are 
powerful radio galaxies in this redshift range with substantially brighter if-band magnitudes, and 
presumably larger stellar masses, than anything in the HDF-N (c.f. De Breuck et al. (2002)). 
Overall, however, galaxies with these large stellar masses at z ~ 3 appear to be quite rare. Wide- 
field (but deep) near-infrared surveys with reliable redshift information will be needed to quantify 
this properly. 



9 In passing, we note that Cole et al. (2001) adopt SFR models which start at z = 20 when fitting the photometry 
for 2dFGRS galaxies and calculating stellar masses. It is therefore possible that their masses are overestimated if, in 
fact, the bulk of stars formed at lower redshifts, as suggested by our observations. However, we also note that their 
characteristic mass estimate M* agrees reasonably well with that from Kauffmann et al. (2002) (after rescaling for 
differences in the assumed IMF), who allowed greater variety when modeling galaxy ages and star formation histories. 
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From large redshift surveys of ^-selected galaxy samples, Cohen (2002) and Cimatti et al. 
(2002b) have argued that the galaxies which make up the bulk of the stellar mass distribution 
today have evolved in a fashion that is broadly consistent with pure luminosity evolution, at least 
from z ~ 1 or 1.5 to the present. We see little evidence to contradict this from the HDF-N. The 
difference in luminosity density from z ~ 1 to the present is broadly consistent with "passive" 
luminosity evolution (~ 0.85 mag in rest-frame L* B ) with only modest (~ 25%) density evolution 
(see §5). At higher redshift, however, our results would strongly disagree with simple prescriptions 
for pure luminosity evolution. 



6.2. Field to-field variations 

Our present analysis is limited to one very deep, but very small, field of view, and is therefore 
subject to uncertainties due to the relatively small co-moving volume and the effects of galaxy 
clustering. We have quantified the shot-noise uncertainties, but we have made no attempt to 
deal with the possible influence of clustering, other than to use very wide redshift intervals when 
analyzing the data in the hope of averaging over line-of-sight variations. Although the co-moving 
volume of each of our redshift bins is roughly equal, the co-moving, line-of-sight path-length 
ranges from 2300/ifo Mpc at 0.5 < z < 1.4 to 530/ifo 1 Mpc at 2.5 < z < 3. We know that the 
redshift distributions of galaxies at both low and high redshift exhibit "spikes," as pencil-beam 
surveys penetrate groups and sheets along the sight-line (cf. Le Fevre et al. (1996), Cohen et al. 
(1996), Adelberger et al. (1998)). We would expect our redshift bins to average over several of 
these overdensities and the "voids" between them. Nevertheless, we may expect that clustering 
will introduce some additional variance, beyond that included in our error estimates. Indeed, it 
may be expected that the most massive galaxies cluster most strongly at any redshift. 

One motivation for the Hubble Deep Field South project (HDF-S, Williams et al. (2000)) was 
to provide a cross-check on results from the HDF-North, as insurance against "cosmic variance". 
Rudnick et al. (2001) have presented deep, near-infrared observations of the HDF-S from the VLT. 
To date, few spectroscopic redshifts are available in the HDF-S, but Rudnick et al. have estimated 
photometric redshifts and rest-frame optical luminosities for galaxies in their sample. They find 
6 galaxies in the HDF-S with 2 < z p h ot < 3 and Lb > 10 11 /iy O 2 L whereas we find two in the 
HDF-N. These differences may be within the range expected from statistical fluctuations, which 
have already been taken into account by our bootstrap error analysis of the luminosity density, 
although larger variance due to clustering (particularly for the most luminous objects) are to be 
expected. The most luminous HDF-S galaxies at 2 < z p hot < 3 are about twice as bright as those 
in the HDF-N. It is important to remember, however, that for distributions like the Schechter 
function, the objects that contribute most to the total luminosity or mass density are those around 
L* or M*, i.e., the "typical" objects, not the brightest ones. Labbe et al. (2002) identify 7 HDF-S 
galaxies with 1.95 < z p h ot < 3.5 and with V — H colors redder than galaxies at similar redshift 
in the HDF-N (cf. PDF Figure 1). If the HDF-S photometric redshift estimates are correct, then 
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these galaxies may have higher M./L than the large majority of galaxies with similar redshifts and 
-B-band luminosities in either the northern or southern fields. 

The differences between the HDF-S and HDF-N may be actually be greater at 0.5 < z < 2, 
where Rudnick et al. (2001) find no galaxies with Lb > W^IijqLq, compared to six in the HDF- 
N. The fact that the HDF-N luminosity density at z ~ 1 agrees well with that measured in other 
surveys that cover wider fields or multiple sight lines gives us some confidence in our mass density 
estimates at that redshift. At 1.4 < z < 2, where both samples rely very heavily on photometric 
redshifts, Rudnick et al. find only two HDF-S galaxies with Lb > 2 x lO lo /i7 O 2 L (roughly present- 
day L* B ), compared to 17 in the HDF-N. Overall, these comparisons point to the need for caution 
interpreting results from any one deep, narrow survey, and highlight the importance of wider fields 
of view and multiple sight lines. 

6.3. Photometric redshift errors 

Many of the galaxies in the HDF-N have only photometric redshift estimates. It is therefore 
important to consider the effects of photometric redshift errors on our results. At all redshifts, 
the brighter galaxies make up a substantial fraction of the total stellar mass density, and in the 
HDF-N most of these have spectroscopic redshifts. For the range of model metallicities and star 
formation histories that we have considered, the fraction of log p* that is made up by objects with 
spectroscopic redshifts in each of our redshift bins is: 0.5 < z < 1.4 - 74-78%; 1.4 < z < 2.0 - 
35-43%; 2.0 < z < 2.5 - 22-28%; 2.5 < z < 3.0 - 32-41%. Photometric redshift errors are therefore 
unlikely to have a dominant effect on mass densities at z ~ 1, but may be more important at higher 
redshifts. 

Photometric redshift errors come in two "flavors": small uncertainties, and catastrophic out- 
liers (§2). To first order, small redshift errors translate quadratically to changes in luminosity and 
hence to the derived masses. We have perturbed our photometric redshifts by amounts drawn from 
the observed A 2 distribution for the spectroscopic sample, truncated at \A Z \ < 0.1. Objects with 
spectroscopic redshifts were not perturbed. The changes in log pi within each redshift bin are small. 
Averaging over many perturbations, the mean and RMS offsets range from —0.006 ± 0.003 dex at 
0.5 < z < 1.4 to +0.05±0.03 dex at 2.5 < z < 3, and are smaller than other computed uncertainties. 

A greater concern is the possibility of catastrophic outliers. The most common cause is aliasing 
between minima in x 2 ( z phot)> e -g-> from confusion between different breaks or inflections in the 
spectral energy distribution. In such cases, it is possible to mistake a faint, low-redshift object for 
a very luminous one at high redshift. Moreover, the rest-frame colors, and hence M./L derived 
from spectral model fitting, could be completely wrong. A moderately red galaxy at low redshift, if 
incorrectly assigned a large z p hot, might be fit with a very red, high-M/L stellar population, or we 
might miss a massive, red, high-z galaxy if it were erroneously placed at low z p hot- The impact of 
such errors is largest at higher redshifts. Transferring a few galaxies between (say) z p hot < 1-4 and 
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2 < z < 3 will have relatively little effect on global quantities at low redshift (where their inferred 
luminosities would be small), but might cause a significant change in the high redshift bins. 

It is difficult to assess the impact of such catastrophic redshift errors formally, but we have 
looked closely at the situation in the HDF-N, and offer the following observations. The largest 
effect would most likely be due to redshift errors for galaxies with relatively bright near-infrared 
magnitudes. Only 18 (out of 107) HDF-N galaxies with .Hi6o < 23 lack spectroscopic redshifts. 
These 18 galaxies all have best-fitting 0.9 < z p h ot < 1.8. Examining the photometric redshift 
likelihood function for each, we find that four have next-best values in the range 2 < z p hot < 3. In 
three of the four cases, x 2 f° r the next-best z p hot is 45 to 125 x poorer than that of the best fit. 
The morphologies and SED shapes strongly suggest that these are ordinary, early-type galaxies at 
1.1 < z < 1.2. One galaxy (4-186) is more problematic. It is best fit by z p hot = 1-71 (Fernandez- 
Soto et al. (1999) find a very similar z p hot = 1-60), but x 2 is only 2.5 x worse at z p hot = 2.86. 
We see no reason to doubt the best-fit value, but this is an example of a galaxy which might, in 
principle, be at higher redshift. With Hiqq = 22.2 and red colors, its stellar mass would be much 
larger if placed at the higher redshift. At 23 < H\qq < 24 there are five more galaxies with best-fit 
z phot < 2 and next-best 2 < z p hot < 3. For three, the next-best x 2 { z phot) values are again far worse, 
and careful inspection makes z > 2 seem unlikely. Two others have smaller x 2 ratios, and for one 
(3-515.11), both possibilities (z p hot = 1-24 or 2.64) seem comparably likely, with x 2 differing by a 
factor of only 1.2. At the larger redshift, this would be a fairly ordinary, ~ L* LBG with blue colors 
and typical M/L, and would only slightly increase the global pM- At still fainter magnitudes, a 
modest rate of catastrophic errors would have very little effect on the global mass densities. 

In another test, we compared two somewhat different photometric redshift fits: one (the default 
for this paper) using the WFPC2+NICMOS+IRIM photometry and "trained" spectral templates 
from Budavari et al. (2000), versus another which excludes the ground-based iT-band data and 
uses more conventional templates based on the Coleman, Wu & Weedman (1980) empirical SEDs. 
Only one blue, faint galaxy shifted into or out of the range 2 < z p hot < 3, with negligible impact on 
luminosity or mass densities. Finally, our photometric redshift estimates can optionally incorporate 
a constraint on rest-frame i?-band luminosity, somewhat similar to the Bayesian priors used in the 
method of Bemtez (2000). This might, in principle, cause erroneous z p hot estimates for unusually 
luminous galaxies at high redshift. However, when we switch off this luminosity prior, no galaxy is 
reassigned to 2 < z p hot < 3, and there is no significant effect on our results. 

Without reliable spectroscopic redshifts for all galaxies, we cannot be absolutely certain that 
photometric redshift errors do not affect our derived luminosity or mass densities. However, from 
the tests performed here we see no strong evidence that this is a significant problem for the HDF- 
N sample. It is important, however, to remember that for some questions, a comparatively small 
error rate in photometric (or spectroscopic) redshifts can introduce potentially large errors in the 
derived results. Other problems (e.g., galaxy clustering) are more robust against modest redshift 
error rates. 
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7. Conclusions 

We have used deep near-infrared imaging of the Hubble Deep Field North to select a sample of 
galaxies based on their optical rest-frame light out to z = 3, and have estimated their stellar mass 
content following the procedures outlined by Papovich, Dickinson & Ferguson (2001). We find that 
the rest-frame -B-band co-moving luminosity density is somewhat larger at high redshift than the 
present-day value, although constant to within a factor of 3 over the redshift range < z < 3. 
However, galaxies at higher redshifts are much bluer than most luminous and massive galaxies 
locally, and the mean mass-to-light ratio evolves steeply with redshift. The result is that the 
global stellar mass density, rises rapidly with cosmic time, going from 3-14% of the present- 
day value at z ~ 2.7, reaching 50-75% of its present value by z ~ 1, and then (based on results 
from the literature) changing little to the present day. In broad terms, the concordance between 
previous estimates of the cosmic star formation history and these new measurements of its time 
integral strongly suggests 1 < z < 2.5 as a critical era, when galaxies were growing rapidly toward 
their final stellar masses. There are hints of a possible inconsistency between the global mass 
density at z « 3 and evidence for high star formation rates at 3 < z < 6. One solution to this 
might be to tilt the IMF toward high-mass star formation at early times, as suggested by Ferguson, 
Dickinson & Papovich (2002). 

Renzini (1999) has recapped the evidence and arguments which suggest that spheroids contain 
> 30% of the stars in the local universe, and that those stellar populations are old and formed at 
high redshift. Recent estimates from the SDSS place > 50% of the local stellar mass density in 
galaxies with red colors and/or large 4000A break amplitudes (Hogg et al. 2002; Kauffmann et al. 
2002). Other estimates have set even larger values for the stellar mass fraction in galaxy spheroids 
(e.g., ~ 75% from Fukugita, Hogan & Peebles (1998)). This would appear to run counter to the 
evidence presented here, which suggests that < 20% of the present-day stellar mass was in place 
at 2 < z < 3. 

Our estimates of Q*(z) are not necessarily inconsistent with the ages of the red stellar popula- 
tions which contribute so substantially to today. The presently favored world model dominated 
by a cosmological constant allows more time to elapse at lower redshifts for a given value of Hq. In 
this case, the old ages of stars in local spheroids are more comfortably accommodated with lower 
formation redshifts, z ~ 2, where the look-back time is « WhjQ Gyr. We have found that most (at 
least half) of the present-day stellar mass was in place at z ~ 1 (corresponding to a lookback time 
of 7.7hjQ Gyr), when the cosmic "building boom" seems to have been winding down. It may be 
that the local amount of old, red starlight can be comfortably accommodated in such a universe. 

A census of stellar populations in galaxies at z ~ 1 may provide a stronger test of our HDF-N 
results at z > 2. Cimatti et al. (2002a) have analyzed composite spectra of red galaxies at z « 1, 
and have argued that a significant fraction of these galaxies are dominated by stellar populations 
with a minimum age of ~ 3 Gyr. Such stars therefore would have formed at z > 2.3 for the 
cosmology adopted here. There is not yet a good estimate of the total, co-moving mass density in 
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old stars at z « 1, but if it were substantial this might prove to be discrepant with evidence for 
a rapid mass build-up from z ~ 3 to 1. If necessary, it might be possible to push our estimate of 
£l*(z > 2) upward toward 30% of the present-day value if each galaxy were assigned its maximum 
stellar mass (at, say, 68% confidence) allowed by our 2-component star formation models - e.g., if 
indeed there were a very early epoch of rapid star formation preceding the redshift range studied 
here. However, once again we note that these models seem ad hoc and somewhat unphysical. 

The robustness of these results is limited by several factors. First, there is the small volume of 
the HDF-N, and the vulnerability of a single sight-line to the effects of large scale structure, which 
we have discussed in §6.2. Our results at z ~ 1 generally agree well with other estimates of the 
luminosity and stellar mass density that can be found in the literature. At higher redshifts, there 
is some evidence for differences between the HDF-N and HDF-S sight lines. It is not yet clear 
if the implied stellar mass densities at high redshift in these two fields disagree by more than our 
estimated uncertainties for the HDF-N alone. Second, photometric data reaching to the If -band 
can sample only rest-frame optical wavelengths at z ~ 3, where the estimates of M/L depend 
strongly on assumptions about the stellar population metallicity and past star formation history. 
Also, at the highest redshifts, even the NICMOS data do not reach far enough down the galaxy 
luminosity function to constrain the total luminosity or stellar mass densities as tightly as one would 
like, leaving significant uncertainty on these integrated quantities. However, if we are missing most 
of the total stellar mass density at 2 < z < 3 for this reason, then it must be found primarily in 
low-luminosity galaxies. This would strongly contrast with the situation today and at intermediate 
redshifts, where the bright end of the luminosity function dominates the integrated stellar mass 
density. Finally, we note that our choice of cosmology does affect the redshift dependence of Q*(z). 
In a flat, matter dominated universe with the same value of Hq, the luminosity densities would be 
80% larger at 2.5 < z < 3.0. However, the ratio of densities between z ~ 1 and z sa 2.7 would be 
change by only 15%, since the change in world model would affect all of the high redshift points. 
Therefore, the general conclusion of a steep increase in at 1 < z < 3 would be essentially the 
same. 

The launch of the Space Infrared Telescope Facility (SIRTF) should help to tie down some of 
these loose ends. In particular, the Great Observatories Origins Deep Survey (GOODS, Dickinson 
et al. (2002)) incorporates a SIRTF Legacy program which will collect the deepest observations 
with that facility at 3.6— 24/«n, in part to address this very issue. The GOODS program should 
help to improve the situation in several ways. It will survey two independent sight-lines, covering 
a solid angle 60 x larger than that considered here. SIRTF observations out to 8/xm will sample 
rest-frame 2^111 light from galaxies out to z = 3, and 1/xm light to z = 7. This should should 
provide much better constraints on stellar masses than do our current NICMOS and ground-based 
data, which only reach optical rest-frame light at high redshift. SIRTF is a comparatively small 
telescope (85 cm aperture), and its sensitivity to the faintest galaxies will be limited by collecting 
area and source confusion. GOODS is designed to robustly detect typical (~ 10 10 M©) Lyman break 
galaxies at z = 3 (and to push to fainter luminosities and higher redshifts over a smaller solid angle 
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in its ultradeep survey). But just as we found with our NICMOS and ground-based data here, 
estimates of the total, integrated mass density may be limited by poor constraints on the faint-end 
slope of the galaxy luminosity function at these large redshifts. Ultimately, observations from the 
James Webb Space Telescope, which will reach nJy sensitivities with observations out to at least 
5/xm, may be required to fully address this problem, and to push toward still higher redshifts and 
earlier epochs. 
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Fig. 1. — Rest-frame 5-band luminosities of galaxies in the HDF-N plotted against redshift z 
(top axis) or co-moving volume out to redshift z (bottom axis). Filled symbols indicate galaxies 
with spectroscopic redshifts, while open symbols are galaxies with photometric redshifts only. The 
horizontal dotted line marks the luminosity of a present-day L* B galaxy from the 2dFGRS luminosity 
function (Norberg et al. 2002). Vertical dashed lines divide the four redshift intervals used for 
analysis in this paper, each of which encloses approximately 10 4 Mpc~ 3 . The curve indicates an 
approximate completeness limit for the sample for a magnitude limit of -Hi60 = 26.5 and assuming 
a spectral energy distribution that is constant in f v flux density. 
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Fig. 2. — Rest-frame 1700A— B colors (AB magnitudes) of HDF-N galaxies versus co-moving 
volume or redshift. Filled and empty symbols are as in Figure 1, and the symbol size scales with 
the rest-frame 5-band galaxy luminosity. No direct measure of the 1700 A rest-frame light is 
available for galaxies at z < 0.75 (vertical dashed line). The galaxy at z ~ 2.7 which is unusually 
red (1700A-5 ss 2.5) for its redshift is HDFN J123651. 7+621221, which exhibits hard X-ray 
(Hornschemeier et al. 2000) and radio (Richards et al. 1999) emission, and is suspected of being 
a type II AGN. It may also be marginally detected at 15 fim (Aussel et al. 1999) and 1.3 mm 
(Downes et al. 1999) as well. 
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Fig. 3. — Estimates of stellar mass for HDF-N galaxies versus co-moving volume or redshift. 
Symbols are as in Figure 1. The mass estimates use Bruzual & Chariot models with solar metallicity 
and the 1-component star formation histories (^f(t) ~ exp(— t/r)) described in the text. Error bars 
showing 68% confidence ranges are shown for the spectroscopic sample only in order to avoid 
overcrowding the figure. Masses estimated from lower metallicity models are generally somewhat 
smaller, while the "maximum A4/L" 2-component star formation histories yield larger masses, 
especially for the objects at higher redshift. The general character of the diagram remains the same, 
however, whichever models are used. The curve shows the mass corresponding to a maximally old 
stellar population, formed in a burst at z = oo and aging passively, with Hiqq = 26.5. The NICMOS 
sample should be complete for all galaxies with stellar masses above this line. Galaxies younger 
and bluer than this maximally old model can be detected to lower mass limits. 
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Fig. 4. — The rest-frame U-band luminosity density contained in galaxies brighter than a given 
luminosity, plotted for various redshift intervals. The lowest curve is an integral over the 2dFGRS 
luminosity function, while the upper histograms show HDF-N galaxies in the redshift intervals 
marked in Figure 1. 
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Fig. 5. — The co-moving rest-frame l?-band luminosity density as a function of redshift. The 
horizontal axis scaling is linear in log(l + z). Our HDF-N results are shown as large filled squares. 
For each point, the horizontal bar shows the redshift range of each bin, while the point position 
is the volume midpoint within this range. Other points show values from the literature, rescaled 
to our adopted cosmology (open circle - Norberg et al. (2002); crosses - Ellis et al. (1996); filled 
circles - Lilly et al. (1996); open squares - Wolf et al. (2002); diamonds - Connolly et al. (1997), 
tabulated in Madau, Pozzetti & Dickinson (1998)). The local value from Norberg et al. (2002) 
includes an evolutionary correction and is therefore plotted at z = 0; the measurements come from 
galaxies at < z < 0.25. Values from Connolly et al. (1997) are also based on HDF-N data, using 
an earlier photometric redshift analysis without NICMOS data. 



-32- 




10 8 10 9 10 10 10" 10 12 



luminosity L B (L Q ) 

Fig. 6. — Cumulative stellar mass densities for HDF-N galaxies brighter than a given rest-frame 
-B-band luminosity, in various redshift intervals. The hatched regions show the range of estimates 
using different stellar population models, going from low metallicity, 1-component ^f(t) models 
(lower bounds) to solar metallicity, 2-component "maximum M/L" models (upper bounds). 
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Fig. 7. — The redshift evolution of the co-moving stellar mass density, Q*. The horizontal axis 
scaling and error bars are as in Figure 5. Open symbols show results from the literature at < z < 1 
(circle - Cole et al. (2001); triangles - Brinchmann & Ellis (2000); squares - Cohen (2002)). The 
HDF-N points (large filled squares) show results for the Zq, 1-component ^?(t) model fits. The 
vertical error bars show the 68% random errors for this choice of model, combining the sampling 
variance and the mass fitting uncertainties. The vertical extent of the boxes show the range of 
systematic uncertainty introduced by varying the metallicity and the star formation histories of 
the mass-fitting model. The blue curves show the result of integrating the cosmic star formation 
history SFR(z) traced by rest-frame UV light, with and without corrections for dust extinction 
(solid and dotted curves) . The dashed green curve shows the integrated star formation history from 
Pei, Fall & Hauser (1999), with their 95% confidence range indicated by the shaded region. 
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Fig. 8. — Same as Figure 7, with curves showing Q*(z) from semi-analytic galaxy evolution models 
by Cole et al. (2000) (cyan dot-long-dashed) and Somerville et al. (2001) (red long-dashed: "colli- 
sional starburst"; dot-short-dashed: "accelerated quiescent"; short-dashed: "constant quiescent"). 
The small, filled magenta triangles show results from combined iV-body and semi-analytic models 
by Kauffmann et al. (1999), rescaled to match the observed z = mass density. As discussed in 
the text, these are probably lower limits to the total fi* at high redshift. 
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Table 1. HDF-N rest-frame 5-band luminosity densities (Q M = 0.3, tt A = 0.7, h = 0.7) 



l/V rnax summation Schechter integration 

z range logp L ±68% ±95% logp L ±68% ±95% 

{h 70 L Q Mpc- 3 ) (h 70 L Q Mpc- 3 ) 



0.5-1.4 


8.49 


+0.05 
-0.05 


+0.09 
-0.10 


8.48 


+0.06 
-0.06 


+0.12 
-0.13 


1.4-2.0 


8.18 


+0.06 
-0.06 


+0.12 
-0.13 


8.25 


+0.15 
-0.11 


+0.52 
-0.26 


2.0-2.5 


8.23 


+0.04 
-0.05 


+0.08 
-0.09 


8.26 


+0.06 
-0.05 


+0.13 
-0.11 


2.5-3.0 


8.11 


+0.07 
-0.09 


+0.15 
-0.18 


8.42 


+0.70 
-0.18 


+oo 
-0.34 


2.5-3.0 a 








8.22 


+0.14 
-0.12 


+0.44 
-0.24 



a Schechter function refit fixing a = — 1.4. 



Table 2. Mean S-band mass-to-light ratios from stellar population fitting 



z range (M/Lb) (solar units) 

Z = 1.0Z n Z = 0.2Z, 



1-comp. 2-comp. 1-comp. 2-comp. 



0.5- 


-1.4 


96+ - 10 
u - yo -0.06 


1 36+ 013 

1 - oo -0.08 


1 10+ 011 
i - iu -0.13 


l-38±g : g 


1.4- 


-2.0 


64+ - 14 
U - D +-0.10 


u - y <>-0.08 


54+ - 11 

u - o4 -0.14 


0.7618:12 


2.0- 


-2.5 


21 +0 - 05 

u - zl -0.02 


^7+°- n 
u - ' -0.07 


13+ 003 

u - lo -0.02 


S5 +0 - 06 
U . JO -0.05 


2.5- 


-3.0 


20 +an 

u - zu -0.03 


0.48l°; 8 


12+ - 07 
u - lz -0.03 


27+ - 14 

u - z ' -0.05 



Table 3. Stellar mass densities (Q M = 0.3, f2 A = 0.7, h = 0.7) 



z range logp* (/i 70 .M© Mpc 3 ) 

Z = 1.0Z n Z = 0.2Z, 



1-comp. 2-comp. 1-comp. 2-comp. 



0.5- 


-1.4 


8.461H? 


o ci +0.07 
O.Dl_ 07 


8 ^2 +0 ' 07 
°- dz -0.08 


8-62±g : g? 


1.4- 


-2.0 


8-06±8;l| 


8 99 +0.16 
°- zz -0.12 


7 n 7 +o.i7 

'• y '-0.17 


S 19+0.16 
8 - i2 -0.13 


2.0- 


-2.5 


' - oo -0.07 


o m +o.09 

8 - Ui -0.08 


7 36+ ' 11 

' - ou -0.08 


7 70+0.10 

' • ' y -0.09 


2.5- 


-3.0 


7 co+0.23 
' - oz -0.14 


7 8Q+ - 20 

' - oy -0.15 


7 97+O.27 
'• z '-0.18 


7 6 , +a22 
'• DO -0.15 



